Display method and display system

ABSTRACT

A display method includes obtaining first information for identifying a user, based on output of a first sensor, obtaining second information which is related to a position of the user, based on output of a second sensor, determining a first direction based on the second information, determining a type of an image based on a combination of the first information and the second information, and projecting image light representing the image of the type toward the first direction with a projector.

The present application is based on, and claims priority from JPApplication Serial Number 2022-104773, filed Jun. 29, 2022, thedisclosure of which is hereby incorporated by reference herein in itsentirety.

BACKGROUND 1. Technical Field

The present disclosure relates to a display method and a display system.

2. Related Art

In International Patent Publication No. WO 2020/031740 (Document 1),there is disclosed a technology of adjusting a projection position and aprojection orientation of an image content based on environmentalinformation representing a use environment of a projector, and userinformation related to a user who uses the projector.

For example, a method of determining the projection position, thecontent, and so on of the image content can affect the convenience ofthe user, but that method is not described in Document 1. Therefore, inthe technology of Document 1, it is difficult to enhance the convenienceof the user when the projector variable in projection direction is used.

SUMMARY

A display method according to an aspect of the present disclosureincludes obtaining first information for identifying a user, based onoutput of a first sensor, obtaining second information which is relatedto a position of the user, based on output of a second sensor,determining a first direction based on the second information,determining a type of an image based on a combination of the firstinformation and the second information, and projecting image lightrepresenting the image of the type toward the first direction with aprojector.

A display system according to another aspect of the present disclosureincludes a first sensor, a second sensor, an optical device configuredto project image light, a drive device configured to turn a direction inwhich the image light is projected to a predetermined direction, and aprocessor, wherein the processor is configured to execute obtainingfirst information for identifying a user, based on output of the firstsensor, obtaining second information which is related to a position ofthe user, based on output of the second sensor, determining a firstdirection based on the second information, determining a type of animage based on a combination of the first information and the secondinformation, and controlling the optical device and the drive device tothereby project the image light representing the image of the typetoward the first direction.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view of a display according to a firstembodiment.

FIG. 2 is a side view of the display system according to the firstembodiment.

FIG. 3 is a block diagram showing a functional configuration of thedisplay system according to the first embodiment.

FIG. 4 is a flowchart showing processing to be executed by a processorin the first embodiment.

FIG. 5 is a plan view showing an installation example of the displaysystem.

FIG. 6 is a diagram showing a condition in which a projection directionis turned to a first direction.

FIG. 7 is a diagram showing an example of a first content selectiontable.

FIG. 8 is a diagram showing a condition in which image light isprojected toward the first direction.

FIG. 9 is a block diagram showing a functional configuration of adisplay system according to a second embodiment.

FIG. 10 is a flowchart showing processing to be executed by a processorin the second embodiment.

FIG. 11 is a plan view showing an installation example of the displaysystem.

FIG. 12 is a diagram showing a condition in which the projectiondirection is turned to the first direction.

FIG. 13 is a diagram showing an example of a second content selectiontable.

FIG. 14 is a diagram showing a condition in which image light isprojected toward the first direction.

FIG. 15 is a block diagram showing a functional configuration of adisplay system according to a third embodiment.

FIG. 16 is a flowchart showing processing to be executed by a processorin the third embodiment.

FIG. 17 is a plan view showing an installation example of the displaysystem.

FIG. 18 is a diagram showing an example of a direction setting table.

FIG. 19 is a diagram showing a condition in which the projectiondirection is turned to the first direction.

FIG. 20 is a diagram showing a condition in which image light isprojected toward the first direction.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

Some embodiments of the present disclosure will hereinafter be describedwith reference to the drawings.

It should be noted that in each of the drawings described below, theconstituents are shown with the scale ratios of respective sizes setdifferently between the constituents in some cases in order to make eachof the constituents eye-friendly.

First Embodiment

First, a first embodiment of the present disclosure will be described.

FIG. 1 is a perspective view showing an appearance of a display system 1according to the present embodiment. FIG. 2 is a side view of thedisplay system 1 shown in FIG. 1 . As shown in FIG. 1 and FIG. 2 , thedisplay system 1 is provided with a projector 10, a pedestal 20, and adrive device 30.

The projector 10 projects image light L on a projection surface notshown to thereby display an image on the projection surface. Theprojection surface can be a dedicated projector screen, or can also be awall surface or the like. As an example, the projector 10 is ahexahedron having six planes. On a front surface 11 of the projector 10,there is disposed a light exit part 12 for emitting the image light Lgenerated inside the projector In the following description, a directionin which the image light L is projected from the projector 10 isreferred to as a “projection direction Dp.” For example, the projectiondirection Dp is a direction perpendicular to the front surface 11, andis a direction of getting away from the projector 10.

The pedestal 20 is a support member for installing the projector 10 at apredetermined place. The pedestal supports the projector 10 and thedrive device 30. As an example, the pedestal 20 has a disc-like shape.The drive device 30 is arranged on an upper surface 21 of the pedestal20, and the pedestal 20 is coupled to a lower surface 13 of theprojector 10 via the drive device 30.

The drive device 30 turns a direction in which the image light L isprojected, namely the projection direction Dp, to a predetermineddirection. Specifically, as shown in FIG. 2 , the drive device 30rotates the projector 10 around at least one of a yaw axis Y and a pitchaxis X to thereby turn the projection direction Dp to the predetermineddirection. The drive device 30 has a first drive device 31 and a seconddrive device 32.

The first drive device 31 rotates the projector around the yaw axis Y.As an example, the first drive device 31 has a columnar shape smaller indiameter than the pedestal 20. The first drive device 31 is arranged onthe upper surface 21 of the pedestal 20 in a state in which a centralaxis of the first drive device 31 coincides with a central axis of thepedestal 20. The central axis of the first drive device 31 is the yawaxis Y. By the first drive device 31 rotating around the yaw axis Y, theprojector 10 also rotates around the yaw axis Y.

The second drive device 32 rotates the projector 10 around the pitchaxis X. As an example, the second drive device 32 has a semicircularcolumn shape. Out of surfaces provided to the second drive device 32, asurface extending in a radial direction of the second drive device 32 iscoupled to the lower surface 13 of the projector 10. The second drivedevice 32 is arranged on an upper end surface of the first drive device31 in a state in which a central axis of the second drive device 32 isperpendicular to the yaw axis Y. The central axis of the second drivedevice 32 is the pitch axis X. By the second drive device 32 rotatingaround the pitch axis X, the projector 10 also rotates around the pitchaxis X.

An operation of the drive device 30 configured as described above iscontrolled by a processor 47 described later. Specifically, a rotationaloperation around the yaw axis Y of the first drive device 31 and arotational operation around the pitch axis X of the second drive device32 are each controlled by the processor 47. More specifically, by eachof a yaw angle θ as a rotational angle around the yaw axis Y of thefirst drive device 31 and a pitch angle α as a rotational angle aroundthe pitch axis X of the second drive device 32 being controlled by theprocessor 47, the projection direction Dp is turned to the predetermineddirection. As described above, in the display system 1 according to thepresent embodiment, the projection direction Dp of the projector 10 isvariable.

FIG. 3 is a block diagram schematically showing a functionalconfiguration of the display system 1. As shown in FIG. 3 , the displaysystem 1 is provided with the projector 10 and the drive device 30described above as constituents having respective functions. Further,the projector 10 is provided with an optical device 41, an input device42, a communication device 43, a microphone array 44, a speaker 45, amemory 46, and the processor 47.

The optical device 41 is controlled by the processor 47 to therebygenerate the image light L representing a color image, and then projectthe image light L thus generated toward the projection direction Dp. Theoptical device 41 has a first image generation panel 41 a, a secondimage generation panel 41 b, a third image generation panel 41 c, adichroic prism 41 d, and a projection optical system 41 e.

The first image generation panel 41 a generates red image light LRrepresenting a red image, and then emits the red image light LR to thedichroic prism 41 d. The first image generation panel 41 a has aplurality of pixels arranged in a matrix, and each of the pixels emitsred light. By the processor 47 controlling an outgoing light intensityof the red light for each of the pixels, the red image light LR isemitted from the first image generation panel 41 a.

The second image generation panel 41 b generates green image light LGrepresenting a green image, and then emits the green image light LG tothe dichroic prism 41 d. The second image generation panel 41 b has aplurality of pixels arranged in a matrix, and each of the pixels emitsgreen light. By the processor 47 controlling an outgoing light intensityof the green light for each of the pixels, the green image light LG isemitted from the second image generation panel 41 b.

The third image generation panel 41 c generates blue image light LBrepresenting a blue image, and then emits the blue image light LB to thedichroic prism 41 d. The third image generation panel 41 c has aplurality of pixels arranged in a matrix, and each of the pixels emitsblue light. By the processor 47 controlling an outgoing light intensityof the blue light for each of the pixels, the blue image light LB isemitted from the third image generation panel 41 c.

For example, each of the image generation panels 41 a, 41 b, and 41 c isa light-emitting electro-optic device such as an OLED (Organic LightEmitting Diode) panel, or a μLED (Micro Light Emitting Diode) panel. Itshould be noted that each of the image generation panels 41 a, 41 b, and41 c can be a non-light-emitting electro-optic device such as a liquidcrystal panel or a DMD (Digital Micromirror Device). When each of theimage generation panels 41 a, 41 b, and 41 c is the non-light-emittingelectro-optic device, the light from a light source not shown such as anLED is separated into the red light, the green light, and the bluelight. The red light enters the first image generation panel 41 a. Thegreen light enters the second image generation panel 41 b. The bluelight enters the third image generation panel 41 c. Further, it is alsopossible to emit light beams of the respective colors in a time-sharingmanner using a single-plate image generation panel.

The dichroic prism 41 d combines the red image light LR, the green imagelight LG, and the blue image light LB with each other to therebygenerate image light L representing a color image and then emit theimage light L to the projection optical system 41 e. The projectionoptical system 41 e is constituted by a plurality of optical elementssuch as a lens, and projects the image light L emitted from the dichroicprism 41 d toward the projection direction Dp in an enlarged manner.Although not shown in the drawings, the projection optical system 41 eis provided with mechanisms capable of adjusting optical parameters suchas a shift amount of a lens, a focus amount of a lens, and a zoomingamount of a lens. By those mechanisms being controlled by the processor47, the optical parameters of the projection optical system 41 e areadjusted.

The input device 42 accepts an input operation by the user to theprojector 10. As an example, the input device 42 includes an operationunit 42 a and a light receiver 42 b. The operation unit 42 a isconstituted by a plurality of operation keys provided to the projector10. For example, the operation keys include a power key, a menuinvocation key, directional keys, a decision key, and a volume controlkey. The operation keys can be hardware keys, or can also be softwarekeys displayed on a touch panel provided to the projector 10. Theoperation unit 42 a outputs an electric signal, which is generated byeach of the operation keys being operated by the user, to the processor47 as an operation signal.

The light receiver 42 b includes a photoelectric conversion circuitwhich receives infrared light transmitted from a remote controller (notshown) of the projector 10, and which converts the infrared light intothe electric signal. The light receiver 42 b outputs the electric signalwhich is obtained by performing the photoelectric conversion on theinfrared light to the processor 47 as a remote operation signal. To theremote controller, there is provided a plurality of operation keyssimilarly to the operation unit 42 a. The remote controller converts theelectric signal generated by each of the operation keys provided to theremote controller being operated by the user into infrared light, andthen transmits the infrared light to the projector 10. In other words,the remote operation signal output from the light receiver 42 b issubstantially the same as the electric signal generated by the useroperating each of the operation keys of the remote controller. It shouldbe noted that when the remote controller transmits a radio signal inaccordance with a near field communication standard such as Bluetooth (aregistered trademark), it is possible to dispose a receiver device forreceiving the radio signal instead of the light receiver 42 b.

The communication device 43 accesses the Internet via a wireless LAN(Local Area Network) compatible with a wireless communication standardsuch as Wi-Fi (a registered trademark) in accordance with an instructionfrom the processor 47 to communicate with a video content deliveryserver (not shown) as an Internet server which provides video contentdelivery service. The communication device 43 outputs the video signalreceived from the video content delivery server to the processor 47.

The microphone array 44 has a plurality of microphones arranged atpredetermined intervals. Each of the microphones converts a voice of theuser into the electric signal. The microphone array 44 outputs theelectric signals obtained from the plurality of microphones to theprocessor 47 as voice signals. The speaker 45 is controlled by theprocessor 47 to thereby output a voice having a predetermined volume.

The memory 46 includes a nonvolatile memory for storing a program and avariety of types of setting data necessary to make the processor 47execute a variety of types of processing, and a volatile memory to beused as a temporary storage of data when the processor 47 executes avariety of types of processing. For example, the nonvolatile memory isan EEPROM (Electrically Erasable Programmable Read-Only Memory) or aflash memory. The volatile memory is, for example, a RAM (Random AccessMemory).

The processor 47 is an arithmetic processing device for controllingoperations of the projector 10 and the drive device 30 in accordancewith the program stored in advance in the memory 46. Citing an example,the processor 47 is formed of a single CPU (Central Processing Unit) ora plurality of CPUs. Some or all of the functions of the processor 47can also be configured by a circuit such as a DSP (Digital SignalProcessor), an ASIC (Application Specific Integrated Circuit), a PLD(Programmable Logic Device), or an FPGA (Field Programmable Gate Array).The processor 47 executes a variety of types of processing in parallelor in sequence.

The processor 47 controls the drive device 30, the optical device 41,and the speaker 45 based on the operation signal input from theoperation unit 42 a, the remote operation signal input from the lightreceiver 42 b, the voice signals input from the microphone array 44, andthe video signal input from the communication device 43. The details ofthe processing to be executed by the processor 47 will be describedlater.

Then, an operation of the display system 1 configured as described abovewill be described.

FIG. 4 is a flowchart showing first display processing to be executed bythe processor 47 in the first embodiment. When the voice signals areinput to the processor 47 from the microphone array 44 in a period inwhich the processor 47 operates in a voice standby mode for awaitinginput of the voice signals, the processor 47 retrieves the program fromthe memory 46 and then executes the program to thereby execute the firstdisplay processing shown in FIG. 4 . By the processor 47 executing thefirst display processing, a display method according to the firstembodiment is realized.

FIG. 5 is a plan view showing an installation example of the displaysystem 1. In the example shown in FIG. 5 , the display system 1 isinstalled at the center in a room 200 disposed at home of the user 100.The room 200 has a north side wall surface 210 located at the north (N)side, a south side wall surface 210 located at the south (S) side, aneast side wall surface 210 located at the east (E) side, and a west sidewall surface 210 located at the west (W) side. In the followingdescription, as shown in FIG. 5 , it is assumed that the processor 47operates in the voice standby mode in a state in which the projectiondirection Dp of the projector 10 is a southward direction, and at thesame time, the user 100 is located at the west side of the displaysystem 1.

When the user 100 utters in the situation shown in FIG. 5 , the voicesignals are output to the processor 47 from the microphone array 44.When the voice signals are input to the processor 47 from the microphonearray 44 in the period in which the processor 47 operates in the voicestandby mode, the processor 47 starts the first display processing shownin FIG. 4 .

As shown in FIG. 4 , when the processor 47 starts the first displayprocessing, the processor 47 first performs (step S1) userauthentication based on the voice signals input from the microphonearray 44 and user information stored in advance in the memory 46. Thestep S1 includes the steps S1 a, S1 b, S1 c, and S1 d.

The user information is information related to a plurality of usersregistered as valid users of the display system 1. The users registeredas the valid users of the display system 1 are hereinafter referred toas “registered users.” As an example, the user information includes userIDs of the registered users, and registered voiceprint data associatedwith the user IDs. The user ID is identification information of theregistered user. For example, the user ID can be a name of theregistered user, or can also be an identification number assignedindividually to the registered user.

The registered voiceprint data is voiceprint data of the registered userobtained by analyzing the voice of the registered user in advance.

Specifically, in the step S1, the processor 47 first performs frequencyanalysis on at least one of the voice signals out of the voice signalsoutput from the plurality of microphones included in the microphonearray 44 to thereby obtain (step S1 a) the voiceprint data of the user100.

Subsequently, the processor 47 determines (step S1 b) whether or not theregistered voiceprint data coinciding with the voiceprint data of theuser 100 is present in the user information. When the registeredvoiceprint data coinciding with the voiceprint data of the user 100 ispresent in the user information (Yes in the step S1 b), the processor 47obtains (step S1 c) the user ID associated with the registeredvoiceprint data coinciding with the voiceprint data of the user 100 outof the user IDs included in the user information as the user ID of theuser 100.

On the other hand, when the registered voiceprint data coinciding withthe voiceprint data of the user 100 is not present in the userinformation (No in the step S1 b), the processor 47 controls (step S1 d)the speaker 45 so as to output a sound of notifying the user 100 of thefact that the user authentication has failed. After the processor 47executes the step S1 d, the processor 47 terminates the first displayprocessing to return to the voice standby mode.

As described above, in the step S1, the processor 47 executes obtainingfirst information of identifying the user 100 based on the output of afirst sensor. In other words, the display method according to the firstembodiment includes obtaining the first information of identifying theuser 100 based on the output of the first sensor. In the firstembodiment, the user ID of the user 100 corresponds to the firstinformation, and the microphone array 44 corresponds to the firstsensor.

Further, in the display method according to the first embodiment, themicrophone array 44 as the first sensor has at least one microphone, andobtaining the first information includes obtaining the voiceprint dataof the user 100 based on the output of at least one microphone, andobtaining the identification information representing the user 100 asthe first information based on the voiceprint data. In the firstembodiment, the user ID of the user 100 corresponds to theidentification information representing the user 100. It should be notedthat since the user authentication technology with the voice is agenerally known technology, the detailed description related to the stepS1 will be omitted in the present embodiment.

Subsequently, the processor 47 determines (step S2) a sound sourcedirection Ds based on the voice signals input from the microphone array44. The sound source direction Ds means a direction at which a soundsource is located with respect to the microphone array 44. It should benoted that since the user 100 is the sound source, the sound sourcedirection Ds can be reworded as a direction in which the user 100 islocated with respect to the microphone array 44.

When distances from the respective microphones included in themicrophone array 44 to the sound source are different from each other,there occur time differences between times at which a sound wave reachesthe respective microphones from the sound source. The differencesoccurring between the times at which the sound wave reaches therespective microphones from the sound source are hereinafter referred toas “sound-wave arrival time differences.” A technology of determining orcalculating the sound source direction Ds based on such sound-wavearrival time differences is generally known as a source localizationtechnology. As an example, in the first embodiment, by using this sourcelocalization technology, the sound source direction Ds is determined.

In other words, in the step S2, the processor 47 calculates thesound-wave arrival time differences based on the voice signals outputfrom the plurality of microphones included in the microphone array 44,and then determines the sound source direction Ds based on thesound-wave arrival time differences thus calculated. As described above,since the source localization technology is a generally knowntechnology, the detailed description related to the step S2 will beomitted. For example, as shown in FIG. 5 , when the user 100 is locatedat the west side of the display system 1, the processor 47 determines“west” as the sound source direction Ds. It should be noted that whendetermining a variety of directions as orientations, it is possible touse an orientation sensor not shown, and it is possible for theprocessor 47 to refer to information which is stored in advance in thememory 46, and which represents a correspondence relationship betweenthe directions and the orientations with reference to the projector 10.

As described above, in the step S2, the processor 47 executes obtainingsecond information related to the position of the user 100 based on theoutput of a second sensor. In other words, the display method accordingto the first embodiment includes obtaining the second informationrelated to the position of the user 100 based on the output of thesecond sensor. The second information includes information representinga second direction in which the user 100 is located with respect to thesecond sensor. In the first embodiment, the microphone array 44corresponds to the second sensor, the sound source direction Ds, namelya direction in which the user 100 is located with respect to themicrophone array 44, corresponds to the second direction, and theinformation representing the second direction corresponds to the secondinformation. As described above, it is possible for the first sensor andthe second sensor to be the same sensor, and it is also possible for thefirst sensor and the second sensor to be sensors different from eachother.

Further, in the display method according to the first embodiment, themicrophone array 44 as the second sensor has the plurality ofmicrophones, and obtaining the second information includes calculatingtime differences between the times at which the sound wave reaches therespective microphones from the sound source, namely the sound-wavearrival time differences, based on the output of the plurality ofmicrophones, and determining the sound source direction Ds as the seconddirection based on the time differences.

As shown in FIG. 4 , the processor 47 executes the step S2 describedabove, and then determines (step S3) the first direction D1 based on thesound source direction Ds. Specifically, in the step S3, the processor47 determines an opposite direction to the sound source direction Ds asthe first direction D1. For example, as shown in FIG. 5 , when theprocessor 47 has determined “west” as the sound source direction Ds, theprocessor 47 determines “east,” which is an opposite direction to thesound source direction Ds, as the first direction D1.

As described above, in the step S3, the processor 47 executesdetermining the first direction D1 based on the information representingthe sound source direction Ds as the second information. In other words,the display method according to the first embodiment includesdetermining the first direction D1 based on the second information.Determining the first direction D1 includes determining the oppositedirection to the sound source direction Ds which is the second directionas the first direction D1.

As shown in FIG. 4 , the processor 47 executes the step S3 describedabove, and then controls (step S4) the drive device 30 so that theprojection direction Dp of the projector 10 is turned to the firstdirection D1. More specifically, in the step S4, the processor 47controls the yaw angle θ of the first drive device 31 and the pitchangle α of the second drive device 32 so that the projection directionDp of the projector 10 is turned to the first direction D1.

FIG. 6 is a diagram showing a condition in which the projectiondirection Dp of the projector 10 is turned to the first direction D1.For example, as described with reference to FIG. 5 , when the processor47 determines “east” as the first direction D1 in the state in which theprojection direction Dp of the projector 10 is set in the southwarddirection, the processor 47 controls the drive device 30 so that theprojection direction Dp of the projector 10 is turned from south toeast. As a result, as shown in FIG. 6 , by the projector 10 rotating 90degrees counterclockwise centering on the yaw axis Y, the projectiondirection Dp of the projector 10 is turned to east.

As shown in FIG. 4 , the processor 47 executes the step S4 describedabove, and then determines (step S5) a projection content based on acombination of the user ID of the user 100 and the sound sourcedirection Ds. The projection content means a video content which isprojected as the image light L from the projector 10 to thereby beprovided to the user 100. The video content means an image product or abroadcast program belonging to a video genre such as movie, TV drama,animation, weather, politics, economy, or sport.

Specifically, in the step S5, the processor 47 determines the projectioncontent based on the combination of the user ID of the user 100 and thesound source direction Ds, and a first content selection table stored inadvance in the memory 46. FIG. 7 is a diagram showing an example of thefirst content selection table. As shown in FIG. 7 , the first contentselection table is data representing correspondence relationshipsbetween combinations of the user IDs and the sound source directions Ds,and the video genres.

For example, in the first content selection table, the combination ofthe user ID corresponding to “user A” and the sound source direction Dscorresponding to “west” is associated with “movie” as the video genre.Further, in the first content selection table, the combination of theuser ID corresponding to “user B” and the sound source direction Dscorresponding to “east” is associated with “weather” as the video genre.Further, in the first content selection table, the combination of theuser ID corresponding to “user C” and the sound source direction Dscorresponding to “south” is associated with “animation” as the videogenre.

In the step S5, the processor 47 first selects the video genrecorresponding to the combination of the user ID of the user 100 and thesound source direction Ds from the video genres included in the firstcontent selection table. For example, when “user A” is obtained as theuser ID of the user 100 in the step S1, and “west” is determined as thesound source direction Ds in the step S2, the processor 47 selects“movie” from the video genres included in the first content selectiontable.

For example, the processor 47 selects the video genre, and thencommunicates with the video content delivery server via thecommunication device 43 to thereby obtain a delivery list of the videocontents belonging to the video genre thus selected from the videocontent delivery server. The processor 47 generates the delivery listimage including the delivery list, and a message of requiring the user100 to perform an operation of selecting the video content from thedelivery list. The processor 47 controls the optical device 41 so thatthe image light L representing the delivery list image is projected.

FIG. 8 is a diagram showing a condition in which the image light L isprojected toward the first direction D1. For example, as shown in FIG. 8, when the processor 47 controls the optical device 41 so that the imagelight L representing the delivery list image is projected in the statein which the projection direction Dp of the projector 10 is turned toeast as an example of the first direction D1, the image light L isprojected eastward from the projector 10. As a result, the delivery listimage is displayed on an east side wall surface 230 located at the eastside, namely a front direction side of the user 100 out of the wallsurfaces of the room 200.

For example, the user 100 performs the operation of selecting the videocontent from the delivery list using the remote controller while lookingat the delivery list image displayed on the east side wall surface 230.When the processor 47 determines that the operation of selecting thevideo content from the delivery list has been received based on a remoteoperation signal input from the light receiver 42 b during a period inwhich the delivery list image is displayed, the processor 47 determinesthe video content selected by the user 100 as the projection content.

Alternatively, it is possible for the processor 47 to determine theprojection content by executing the following processing. For example,when the video signals of a plurality of video contents belonging toeach of the video genres are stored in advance in the memory 46, theprojector 47 generates an archive list of the video contents belongingto the video genre thus selected. The processor 47 generates an archivelist image including the archive list, and a message of requiring theuser 100 to perform an operation of selecting the video content from thearchive list. The processor 47 controls the optical device 41 so thatthe image light L representing the archive list image is projected.

For example, the user 100 performs the operation of selecting the videocontent from the archive list using the remote controller while lookingat the archive list image displayed. When the processor 47 determinesthat the operation of selecting the video content from the archive listhas been received based on the remote operation signal input from thelight receiver 42 b during a period in which the archive list image isdisplayed, the processor 47 determines the video content selected by theuser 100 as the projection content.

As described above, in the step S5, the processor 47 executesdetermining a type of the image based on a combination of the firstinformation and the second information. In other words, the displaymethod according to the first embodiment includes determining the typeof the image based on the combination of the first information and thesecond information. In the first embodiment, the user ID of the user 100corresponds to the first information, the information representing thesound source direction Ds corresponds to the second information, and theprojection content corresponds to the type of the image. In other words,the type of the image means the video content such as the image productor the broadcast program classified according to the video genre.

As shown in FIG. 4 , the processor 47 executes the step S5 describedabove, and then controls (step S6) the optical device 41 so that theimage light L representing the image of the projection content isprojected. Specifically, in the step S6, the processor 47 receives thevideo signal of the video content determined as the projection contentfrom the video content delivery server via the communication device 43,or retrieves that video signal from the memory 46. Then, the processor47 controls the optical device 41 so that the image light L representingthe image based on the image data included in the video signal isprojected, and controls the speaker 45 so that the sound based on theaudio data included in the video signal is output.

For example, as shown in FIG. 8 , when the processor 47 controls theoptical device 41 so that the image light L representing the image ofthe projection content is projected in the state in which the projectiondirection Dp of the projector 10 is turned to east as an example of thefirst direction D1, the image light L is projected eastward from theprojector 10. As a result, the image of the video content determined asthe projection content is displayed on the east side wall surface 230located at the front direction side of the user 100 out of the wallsurfaces of the room 200.

As described above, in the steps S4 and S6, the processor 47 controlsthe optical device 41 and the drive device 30 to thereby executeprojecting the image light L representing the image of the projectioncontent as the image of the determined type toward the first directionD1. In other words, the display method according to the first embodimentincludes projecting the image light L representing the image of thedetermined type toward the first direction D1 with the projector 10.

Advantages of First Embodiment

As described above, the display method according to the first embodimentincludes obtaining the user ID as the first information for identifyingthe user 100 based on the output of the microphone array 44 as the firstsensor, obtaining the information representing the sound sourcedirection Ds as the second information related to the position of theuser 100 based on the output of the microphone array 44 as the secondsensor, determining the first direction D1 based on the secondinformation, determining the projection content as the type of the imagebased on the combination of the first information and the secondinformation, and projecting the image light L representing the image ofthe projection content as the image of the determined type toward thefirst direction D1 with the projector 10.

The video content demanded by the user 100 is different not only by anindividual attribute such as the age, the gender, a job, or a hobby butalso by the position of the user 100 in some cases. In the displaymethod according to the first embodiment, the projection content isdetermined based on the first information of identifying the user 100and the second information related to the position of the user 100, andthe image light L representing the image of the projection content isprojected toward the first direction D1 determined based on the secondinformation.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaymethod in the first embodiment, it is possible to enhance theconvenience of the user 100 when using the projector 10 the projectiondirection Dp of which is variable.

In the display method according to the first embodiment, the secondinformation includes the information representing the sound sourcedirection Ds as the second direction in which the user 100 is locatedwith respect to the microphone array 44 as the second sensor, anddetermining the first direction D1 includes determining the oppositedirection to the sound source direction Ds which is the second directionas the first direction D1.

As described above, by determining the opposite direction to the seconddirection in which the user 100 is located with respect to the secondsensor as the first direction D1, it is possible to display the image ofthe projection content on the projection surface which is located at thefront direction side of the user 100, namely the projection surfacewhich is easy for the user 100 to visually recognize, and therefore, theconvenience of the user 100 is enhanced.

In the display method according to the first embodiment, determining theprojection content as the type of the image includes determining theprojection content as the type of the image based on the combination ofthe user ID as the first information and the sound source direction Dsas the second direction.

As described above, by determining the projection content based on thecombination of the user ID as the first information and the sound sourcedirection Ds as the second direction, it is possible to display theimage of the video content suitable for the combination of theindividual attribute of the user 100 and the second direction in whichthe user 100 is located on the projection surface located at the frontdirection side of the user 100, and therefore, the convenience of theuser 100 is enhanced.

In the display method according to the first embodiment, the microphonearray 44 as the second sensor has the plurality of microphones, andobtaining the second information includes calculating the timedifferences between the times at which the sound wave reaches therespective microphones from the sound source based on the output of theplurality of microphones, and determining the sound source direction Dsas the second direction based on the time differences.

As described above, by calculating the time differences between thetimes at which the sound wave reaches the respective microphones fromthe sound source based on the output of the respective microphones, itis possible to accurately obtain the sound source direction Ds as thedirection in which the sound source is located with respect to thesecond sensor as the second direction in which the user 100 is located.

In the display method according to the first embodiment, the microphonearray 44 as the first sensor has at least one microphone, and obtainingthe first information includes obtaining the voiceprint data of the user100 based on the output of at least one microphone, and obtaining userID as the identification information representing the user 100 as thefirst information based on the voiceprint data.

As described above, by obtaining the voiceprint data as biological dataunique to the user 100 based on the output of at least one microphone,it is possible to accurately obtain the user ID of the user 100 as thefirst information. Further, as in the first embodiment, since the firstsensor and the second sensor are the same sensor, namely the microphonearray 44, it is possible to obtain both of the first information and thesecond information based on the output of that single sensor.

The display system 1 according to the first embodiment is provided withthe microphone array 44 as the first sensor, the microphone array 44 asthe second sensor, the optical device 41 for projecting the image lightL, the drive device 30 for turning the direction in which the imagelight L is projected to the predetermined direction, and the processor47. The processor 47 executes obtaining the user ID as the firstinformation for identifying the user 100 based on the output of thefirst sensor, obtaining the information representing the sound sourcedirection Ds as the second information related to the position of theuser 100 based on the output of the second sensor, determining the firstdirection D1 based on the second information, determining the projectioncontent as the type of the image based on the combination of the firstinformation and the second information, and projecting the image light Lrepresenting the image of the projection content as the image of thedetermined type toward the first direction D1 by controlling the opticaldevice 41 and the drive device 30.

In the display system 1 according to the first embodiment, theprojection content is determined based on the first information ofidentifying the user 100 and the second information related to theposition of the user 100, and the image light L representing the imageof the projection content is projected toward the first direction D1determined based on the second information.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaysystem 1 in the first embodiment, it is possible to enhance theconvenience of the user 100 when using the projector 10 the projectiondirection Dp of which is variable.

Second Embodiment

A second embodiment of the present disclosure will hereinafter bedescribed. In each of the aspects illustrated hereinafter, constituentscommon to those of the first embodiment are denoted by the samereference symbols as those used in the first embodiment, and thedetailed description thereof will arbitrarily be omitted.

FIG. 9 is a block diagram schematically showing a functionalconfiguration of a display system 2 according to the second embodiment.As shown in FIG. 9 , the display system 2 is provided with a projector10A and the drive device 30 as constituents having respective functions.The projector 10A according to the second embodiment coincides with theprojector 10 according to the first embodiment in the point that thereare provided the optical device 41, the input device 42, thecommunication device 43, the speaker 45, the memory 46, and theprocessor 47.

The projector 10A is different from the projector 10 in the point that amicrophone 48 is provided as the first sensor instead of the microphonearray 44. Further, the projector 10A is different from the projector 10in the point that a first camera 49 is provided as the second sensor.The difference between the second embodiment and the first embodimentwill hereinafter be described in detail.

The microphone 48 converts the voice of the user 100 into an electricsignal, and then outputs the electric signal to the processor 47 as thevoice signal. The first camera 49 is a digital camera for taking animage in one direction. The first camera 49 is attached to the projector10A so as to take an image in the projection direction Dp. In otherwords, the first camera 49 is attached to the projector 10A so that theimaging direction of the first camera 49 coincides with the projectiondirection Dp. The first camera 49 outputs taken image data representinga taken image to the processor 47.

Then, an operation of the display system 2 configured as described abovewill be described.

FIG. 10 is a flowchart showing second display processing to be executedby the processor 47 in the second embodiment. When the voice signal isinput to the processor 47 from the microphone 48 in a period in whichthe processor 47 operates in the voice standby mode, the processor 47retrieves the program from the memory 46 and then executes the programto thereby execute the second display processing shown in FIG. 10 . Bythe processor 47 executing the second display processing, a displaymethod according to the second embodiment is realized.

FIG. 11 is a plan view showing an installation example of the displaysystem 2. In the example shown in FIG. 11 , the display system 2 isinstalled at the center in the room 200 disposed at home of the user 100similarly to the example shown in FIG. 5 . In the following description,as shown in FIG. 11 , it is assumed that the processor 47 operates inthe voice standby mode in a state in which the projection direction Dpof the projector 10A is an eastward direction, and at the same time, theuser 100 is located at the east side of the display system 2. In thiscase, the first camera 49 takes an image in the eastward direction asthe same direction as the projection direction Dp.

When the user 100 utters in the situation shown in FIG. 11 , the voicesignal is output to the processor 47 from the microphone 48. When thevoice signal is input to the processor 47 from the microphone 48 in theperiod in which the processor 47 operates in the voice standby mode, theprocessor 47 starts the second display processing shown in FIG. 10 .

As shown in FIG. 10 , when the processor 47 starts the second displayprocessing, the processor 47 first performs (step S11) the userauthentication based on the voice signal input from the microphone 48and the user information stored in advance in the memory 46. The stepS11 includes the steps S11 a, S11 b, S11 c, and S11 d. Since theprocessing in the step S11 in the second display processing issubstantially the same as the processing in the step S1 in the firstdisplay processing, the processing in the step S11 will hereinafter bebriefly described.

In the step S11, the processor 47 first performs the frequency analysison the voice signal output from the microphone 48 to thereby obtain(step S11 a) the voiceprint data of the user 100. The processor 47determines (step S11 b) whether or not the registered voiceprint datacoinciding with the voiceprint data of the user 100 is present in theuser information. When the registered voiceprint data coinciding withthe voiceprint data of the user 100 is present in the user information(Yes in the step S11 b), the processor 47 obtains (step S11 c) the userID associated with the registered voiceprint data coinciding with thevoiceprint data of the user 100 out of the user IDs included in the userinformation as the user ID of the user 100.

On the other hand, when the registered voiceprint data coinciding withthe voiceprint data of the user 100 is not present in the userinformation (No in the step S11 b), the processor 47 controls (step S11d) the speaker 45 so as to output a sound of notifying the user 100 ofthe fact that the user authentication has failed. After the processor 47executes the step S11 d, the processor 47 terminates the second displayprocessing to return to the voice standby mode.

As described above, in the step S11, the processor 47 executes obtainingthe first information of identifying the user 100 based on the output ofthe first sensor. In other words, the display method according to thesecond embodiment includes obtaining the first information ofidentifying the user 100 based on the output of the first sensor. In thesecond embodiment, the user ID corresponds to the first information, andthe microphone 48 corresponds to the first sensor.

Further, in the display method according to the second embodiment, thefirst sensor has at least one microphone 48, and obtaining the firstinformation includes obtaining the voiceprint data of the user 100 basedon the output of at least one microphone 48, and obtaining the user IDwhich is the identification information representing the user 100 as thefirst information based on the voiceprint data.

Subsequently, the processor 47 determines (step S12) a user direction Dubased on the taken image data input from the first camera 49. The userdirection Du means a direction in which the user 100 is located withrespect to the first camera 49. For example, as shown in FIG. 11 , whenthe first camera 49 takes the image in the eastward direction as theprojection direction Dp in the state in which the user 100 is located atthe east side of the display system 2, the taken image data representingthe taken image in which the user 100 shows up is output from the firstcamera 49 to the processor 47.

The user information in the second embodiment includes facialidentification information associated with the user ID in addition tothe user ID of the registered user, and the registered voiceprint data.The facial identification information is information for identifying aface of the registered user. In the step S12, the processor 47 obtainsthe facial identification information associated with the user ID of theuser 100 out of the facial identification information included in theuser information. Then, the processor 47 performs an image analysis ofthe taken image based on the taken image data and the facialidentification information to thereby determine an image areacorresponding to the face of the user 100 out of an image area includedin the taken image as a user image area.

In the second embodiment, a coordinate conversion formula for convertingthe coordinate in the image coordinate system of the taken image into acoordinate in a coordinate system representing a movable range of theprojection direction Dp is stored in advance in the memory 46. Thecoordinate system representing the movable range of the projectiondirection Dp is a coordinate system defined by the yaw angle θ and thepitch angle α. In the step S12, the processor 47 converts the centralcoordinate of the user image area in the image coordinate system intothe coordinate defined by the yaw angle θ and the pitch angle α based onthis coordinate conversion formula. The coordinate obtained by suchcoordinate conversion represents the direction in which the user 100 islocated with respect to the first camera 49. In other words, theprocessor 47 obtains the direction corresponding to the coordinateobtained by the coordinate conversion as the user direction Du. Forexample, the processor 47 obtains the orientation corresponding to thecoordinate as the user direction Du with reference to the tablerepresenting the correspondence relationship between the orientationsstored in advance in the memory 46 and the coordinate systemrepresenting the movable range of the projection direction Dp. As shownin FIG. 11 , when the user 100 is located at the east side of thedisplay system 2, the processor 47 obtains “east” corresponding to thecoordinate as the user direction Du. It should be noted that it ispossible for the processor 47 to obtain the coordinate itself in thecoordinate system representing the movable range of the projectiondirection Dp as the user direction Du.

As described above, in the step S12, the processor 47 executes obtainingthe second information related to the position of the user 100 based onthe output of the second sensor. In other words, the display methodaccording to the second embodiment includes obtaining the secondinformation related to the position of the user 100 based on the outputof the second sensor. The second information includes informationrepresenting the second direction in which the user 100 is located withrespect to the second sensor. In the second embodiment, the first camera49 corresponds to the second sensor, the user direction Du, namely adirection in which the user 100 is located with respect to the firstcamera 49, corresponds to the second direction, and the informationrepresenting the second direction corresponds to the second information.

Further, in the display method according to the second embodiment,obtaining the second information includes obtaining the first imageincluding the user 100 based on the output of the first camera 49, anddetermining the user direction Du as the second direction based on thefirst image. As described above, out of the taken image obtained fromthe first camera 49, the taken image in which the user 100 shows upcorresponds to the first image.

It should be noted that when the user image area is not present in thetaken image obtained when starting the step S12, it is conceivable thatthe user 100 is not present in the projection direction Dp as theimaging direction of the first camera 49. Therefore, when the user imagearea is not present in the taken image obtained when starting the stepS12, the processor 47 obtains the taken image data from the first camera49 at predetermined time intervals while controlling the drive device 30so that the projector 10A makes one revolution around the yaw axis Y.Further, the processor 47 determines whether or not the user image areais present in the taken image every time the processor 47 obtains thetaken image data. When the processor 47 determines that the user imagearea is present in the taken image, the processor 47 stops the controlof the drive device 30 and executes the coordinate conversion describedabove to thereby determine the user direction Du.

As shown in FIG. 10 , the processor 47 executes the step S12 describedabove, and then determines (step S13) the first direction D1 based onthe user direction Du. Specifically, in the step S13, the processor 47determines an opposite direction to the user direction Du as the firstdirection D1. For example, as shown in FIG. 11 , when the processor 47has determined “east” as the user direction Du, the processor 47determines “west,” which is an opposite direction to the user directionDu, as the first direction D1.

As described above, in the step S13, the processor 47 executesdetermining the first direction D1 based on the information representingthe user direction Du as the second information. In other words, thedisplay method according to the second embodiment includes determiningthe first direction D1 based on the information representing the userdirection Du as the second information. Determining the first directionD1 includes determining the opposite direction to the user direction Duwhich is the second direction as the first direction D1.

As shown in FIG. 10 , the processor 47 executes the step S13 describedabove, and then controls (step S14) the drive device 30 so that theprojection direction Dp of the projector 10A is turned to the firstdirection D1. More specifically, in the step S14, the processor 47controls the yaw angle θ of the first drive device 31 and the pitchangle α of the second drive device 32 so that the projection directionDp of the projector 10A is turned to the first direction D1. Thus, theimaging direction of the first camera 49 is also turned to the firstdirection D1.

FIG. 12 is a diagram showing a condition in which the projectiondirection Dp of the projector 10A is turned to the first direction D1.For example, as described with reference to FIG. 11 , when the processor47 determines “west” as the first direction D1 in the state in which theprojection direction Dp of the projector 10A is set in the eastwarddirection, the processor 47 controls the drive device 30 so that theprojection direction Dp of the projector 10A is turned from east towest. As a result, as shown in FIG. 12 , by the projector 10A rotating180 degrees counterclockwise centering on the yaw axis Y, the projectiondirection Dp of the projector 10A is turned to west. In this case, theimaging direction of the first camera 49 is also turned to west.

As shown in FIG. 10 , the processor 47 executes the step S14 describedabove, and then determines (step S15) a viewing place based on the takenimage data input from the first camera 49. The viewing place means aplace where the user 100 is located.

For example, as shown in FIG. 12 , when the first camera 49 takes theimage in the first direction D1 in the state in which the projectiondirection Dp is turned to “west” as the first direction D1, the takenimage data representing the taken image in which an area located at thefirst direction D1 side out of the area in the room 200, namely an areaat the west side including the west side wall surface 240, shows up isoutput from the first camera 49 to the processor 47.

In the step S15, the processor 47 determines one of a plurality ofviewing place candidates as the viewing place based on the taken imagedata. For example, in the plurality of viewing place candidates, thereare included rooms such as a living room, a bedroom, and a washroom. Inthe memory 46, as reference image data, there is stored in advance imagedata obtained by imaging the inside of the rooms as the viewing placecandidates using the first camera 49.

Specifically, in the step S15, the processor 47 calculates thesimilarity between the taken image represented by the taken image dataand a reference image represented by the reference image data usingimage processing such as pattern matching. The reference image is animage obtained by imaging the inside of the room as the viewing placecandidate using the first camera 49 as described above. Further, theprocessor 47 determines the viewing place candidate where the referenceimage the highest in similarity to the taken image is obtained out ofthe plurality of viewing place candidates as the viewing place.

As described above, in the display method according to the secondembodiment, the second information related to the position of the user100 further includes information representing the viewing place as aplace where the user 100 is located in addition to the informationrepresenting the user direction Du as the second direction in which theuser 100 is located. Further, in the display method according to thesecond embodiment, obtaining the second information includes obtaining asecond image including an area located in the first direction D1 basedon the output of the first camera 49, and determining the viewing placebased on the second image. As described above, out of the taken imageobtained from the first camera 49, the taken image obtained by takingthe image in the first direction D1 corresponds to the second image.

As shown in FIG. 10 , the processor 47 executes the step S15 describedabove, and then determines (step S16) the projection content based on acombination of the user ID of the user 100 and the viewing place.Specifically, in the step S16, the processor 47 determines theprojection content based on the combination of the user ID of the user100 and the viewing place, and a second content selection table storedin advance in the memory 46. FIG. 13 is a diagram showing an example ofthe second content selection table. As shown in FIG. 13 , the secondcontent selection table is data representing correspondencerelationships between the combinations of the user IDs and the viewingplaces, and the video genres.

For example, in the second content selection table, the combination ofthe user ID corresponding to “user A” and the viewing placecorresponding to “living room” is associated with “movie” as the videogenre. Further, in the second content selection table, the combinationof the user ID corresponding to “user B” and the viewing placecorresponding to “bedroom” is associated with “cosmetics” as the videogenre. Further, in the second content selection table, the combinationof the user ID corresponding to “user C” and the viewing placecorresponding to “washroom” is associated with “animation” as the videogenre.

In the step S16, the processor 47 first selects the video genrecorresponding to the combination of the user ID of the user 100 and theviewing place from the video genres included in the second contentselection table. For example, when “user A” is obtained as the user IDof the user 100 in the step S11, and “living room” is determined as theviewing place in the step S15, the processor 47 selects “movie” from thevideo genres included in the second content selection table. Theprocessor 47 performs the same processing as the processing described inthe first embodiment after selecting the video genre to therebydetermine the projection content.

As described above, in the step S16, the processor 47 executesdetermining the projection content as a type of the image based on acombination of the user ID as the first information and the informationrepresenting the viewing place as the second information. In otherwords, the display method according to the second embodiment includesdetermining the projection content as a type of the image based on thecombination of the user ID as the first information and the informationrepresenting the viewing place as the second information. Further, thesecond information includes the information representing the viewingplace as a place where the user is located, and determining theprojection content as the type of the image includes determining theprojection content as the type of the image based on the combination ofthe user ID as the first information and the viewing place.

As shown in FIG. 10 , the processor 47 executes the step S16 describedabove, and then controls (step S17) the optical device 41 so that theimage light L representing the image of the projection content isprojected. Since the processing in the step S17 in the second displayprocessing is the same as the processing in the step S6 in the firstdisplay processing, the description related to the step S17 will beomitted.

FIG. 14 is a diagram showing a condition in which the image light L isprojected toward the first direction D1. For example, as shown in FIG.14 , when the processor 47 controls the optical device 41 so that theimage light L representing the projection content is projected in thestate in which the projection direction Dp of the projector is turned towest as an example of the first direction D1, the image light L isprojected westward from the projector 10A. As a result, the image of thevideo content determined as the projection content is displayed on thewest side wall surface 240 located at the front direction side of theuser 100 out of the wall surfaces of the room 200.

As described above, in the steps S14 and S17, the processor 47 controlsthe optical device 41 and the drive device 30 to thereby executeprojecting the image light L representing the image of the projectioncontent as the image of the determined type toward the first directionD1. In other words, the display method according to the secondembodiment includes projecting the image light L representing the imageof the projection content as the image of the determined type toward thefirst direction D1 with the projector 10A.

Advantages of Second Embodiment

As described above, the display method according to the secondembodiment includes obtaining the user ID as the first information foridentifying the user 100 based on the output of the microphone 48 as thefirst sensor, obtaining the information representing the user directionDu and the viewing place as the second information related to theposition of the user 100 based on the output of the first camera 49 asthe second sensor, determining the first direction D1 based on theinformation representing the user direction Du as the secondinformation, determining the projection content as the type of the imagebased on the combination of the first information and the informationrepresenting the viewing place as the second information, and projectingthe image light L representing the image of the projection content asthe image of the determined type toward the first direction D1 with theprojector 10A.

In the display method according to the second embodiment, similarly tothe first embodiment, the projection content is determined based on thefirst information of identifying the user 100 and the second informationrelated to the position of the user 100, and the image light Lrepresenting the image of the projection content is projected toward thefirst direction D1 determined based on the second information.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaymethod in the second embodiment, it is possible to enhance theconvenience of the user 100 when using the projector the projectiondirection Dp of which is variable.

In the display method according to the second embodiment, the secondinformation includes the information representing the user direction Duas the second direction in which the user 100 is located with respect tothe first camera 49 as the second sensor, and determining the firstdirection D1 includes determining the opposite direction to the userdirection Du which is the second direction as the first direction D1.

As described above, by determining the opposite direction to the seconddirection in which the user 100 is located with respect to the secondsensor as the first direction D1, it is possible to display the image ofthe projection content on the projection surface which is located at thefront direction side of the user 100, namely the projection surfacewhich is easy for the user 100 to visually recognize, and therefore, theconvenience of the user 100 is enhanced.

In the display method according to the second embodiment, the secondinformation further includes the information representing the viewingplace as a place where the user 100 is located, and determining theprojection content as the type of the image includes determining theprojection content as the type of the image based on the combination ofthe user ID as the first information and the viewing place.

In the first embodiment, the projection content is determined based onthe combination of the user ID as the first information and the soundsource direction Ds. Since the sound source direction Ds is consistentlya direction in which the user 100 is located with respect to the secondsensor, it is difficult to determine the place where the user 100 islocated, namely the room or the like to be the viewing place, from thesound source direction Ds.

Therefore, as described above, by determining the projection contentbased on the combination of the user ID as the first information and theviewing place, it is possible to display the image of the video contentwhich is suitable for the individual attribute of the user 100 and theviewing place on the projection surface, and therefore, the convenienceof the user 100 is further enhanced compared to the first embodiment.

In the display method according to the second embodiment, the secondsensor is the first camera 49 for taking an image in one direction,obtaining the second information includes obtaining the first imageincluding the user 100 based on the output of the first camera 49,determining the user direction Du as the second direction based on thefirst image, obtaining the second image including the area located inthe first direction D1 based on the output of the first camera 49, anddetermining the viewing place based on the second image.

As described above, by determining both of the user direction Du and theviewing place based on the first image and the second image obtainedfrom the first camera 49, it is possible to accurately obtain the secondinformation related to the position of the user 100 using a singlecamera.

In the display method according to the second embodiment, the firstsensor has at least one microphone 48, and obtaining the firstinformation includes obtaining the voiceprint data of the user 100 basedon the output of at least one microphone 48, and obtaining the user IDwhich is the identification information representing the user 100 as thefirst information based on the voiceprint data.

As described above, by obtaining the voiceprint data as biological dataunique to the user 100 based on the output of at least one microphone48, it is possible to accurately obtain the user ID of the user 100 asthe first information.

The display system 2 according to the second embodiment is provided withthe microphone 48 as the first sensor, the first camera 49 as the secondsensor, the optical device 41 for projecting the image light L, thedrive device 30 for turning the direction in which the image light L isprojected to the predetermined direction, and the processor 47. Theprocessor 47 executes obtaining the user ID as the first information foridentifying the user 100 based on the output of the first sensor,obtaining the information representing the user direction Du as thesecond information related to the position of the user 100 based on theoutput of the second sensor, determining the first direction D1 based onthe information representing the user direction Du as the secondinformation, determining the projection content as the type of the imagebased on the combination of the first information and the informationrepresenting the viewing place as the second information, and projectingthe image light L representing the image of the projection content asthe image of the determined type toward the first direction D1 bycontrolling the optical device 41 and the drive device 30.

In the display system 2 according to the second embodiment, theprojection content is determined based on the first information ofidentifying the user 100 and the information representing the viewingplace as the second information related to the position of the user 100,and the image light L representing the image of the projection contentis projected toward the first direction D1 determined based on theinformation representing the user direction Du as the secondinformation.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaysystem 2 in the second embodiment, it is possible to enhance theconvenience of the user 100 when using the projector 10A the projectiondirection Dp of which is variable.

Third Embodiment

A third embodiment of the present disclosure will hereinafter bedescribed.

FIG. 15 is a block diagram schematically showing a functionalconfiguration of a display system 3 according to the third embodiment.As shown in FIG. 15 , the display system 3 is provided with a projector10B and the drive device 30 as constituents having respective functions.The projector 10B according to the third embodiment coincides with theprojector 10A according to the second embodiment in the point that thereare provided the optical device 41, the input device 42, thecommunication device 43, the speaker 45, the memory 46, the processor47, and the microphone 48.

The projector 10B is different from the projector in the point that asecond camera 50 is provided as the second sensor instead of the firstcamera 49. The difference between the third embodiment and the secondembodiment will hereinafter be described in detail.

The second camera 50 is a digital camera for taking an image in a360-degree direction centering on the second camera 50. For example, thesecond camera 50 is attached on an upper surface of a chassis of theprojector The second camera 50 outputs taken image data representing ataken image to the processor 47.

Then, an operation of the display system 3 configured as described abovewill be described.

FIG. 16 is a flowchart showing third display processing to be executedby the processor 47 in the third embodiment. When the voice signal isinput to the processor 47 from the microphone 48 in a period in whichthe processor 47 operates in the voice standby mode, the processor 47retrieves the program from the memory 46 and then executes the programto thereby execute the third display processing shown in FIG. 16 . Bythe processor 47 executing the third display processing, a displaymethod according to the third embodiment is realized.

FIG. 17 is a plan view showing an installation example of the displaysystem 3. In the example shown in FIG. 17 , the display system 3 isinstalled at the center in the room 200 disposed at home of the user 100similarly to the example shown in FIG. 5 . In the following description,as shown in FIG. 17 , it is assumed that the processor 47 operates inthe voice standby mode in a state in which the projection direction Dpof the projector 10B is the eastward direction, and at the same time,the user 100 is located at the east side of the display system 3. Thesecond camera 50 takes an image in a 360-degree direction centering onthe second camera 50.

When the user 100 utters in the situation shown in FIG. 17 , the voicesignal is output to the processor 47 from the microphone 48. When thevoice signal is input to the processor 47 from the microphone 48 in theperiod in which the processor 47 operates in the voice standby mode, theprocessor 47 starts the third display processing shown in FIG. 16 .

As shown in FIG. 16 , when the processor 47 starts the third displayprocessing, the processor 47 first performs (step S21) the userauthentication based on the voice signal input from the microphone 48and the user information stored in advance in the memory 46. The stepS21 includes the steps S21 a, S21 b, S21 c, and S21 d. Since theprocessing in the step S21 in the third display processing is the sameas the processing in the step S11 in the second display processing, theprocessing in the step S21 will hereinafter be briefly described.

In the step S21, the processor 47 first performs the frequency analysison the voice signal output from the microphone 48 to thereby obtain(step S21 a) the voiceprint data of the user 100. The processor 47determines (step S21 b) whether or not the registered voiceprint datacoinciding with the voiceprint data of the user 100 is present in theuser information. When the registered voiceprint data coinciding withthe voiceprint data of the user 100 is present in the user information(Yes in the step S21 b), the processor 47 obtains (step S21 c) the userID associated with the registered voiceprint data coinciding with thevoiceprint data of the user 100 out of the user IDs included in the userinformation as the user ID of the user 100.

On the other hand, when the registered voiceprint data coinciding withthe voiceprint data of the user 100 is not present in the userinformation (No in the step S21 b), the processor 47 controls (step S21d) the speaker so as to output a sound of notifying the user 100 of thefact that the user authentication has failed. After the processor 47executes the step S21 d, the processor 47 terminates the third displayprocessing to return to the voice standby mode.

As described above, in the step S21, the processor 47 executes obtainingthe first information of identifying the user 100 based on the output ofthe first sensor. In other words, the display method according to thethird embodiment includes obtaining the first information of identifyingthe user 100 based on the output of the first sensor. In the thirdembodiment, the user ID corresponds to the first information, and themicrophone 48 corresponds to the first sensor.

Subsequently, the processor 47 determines (step S22) the viewing placebased on the taken image data input from the second camera 50. Similarlyto the second embodiment, the viewing place means a place where the user100 is located.

For example, as shown in FIG. 17 , when the second camera 50 takes theimage in the 360-degree direction in the state in which the displaysystem 3 is installed at the center of the room 200, the taken imagedata representing the taken image in which an area included in a360-degree range centering on the second camera 50 out of the area inthe room 200 shows up is output from the second camera 50 to theprocessor 47.

In the step S22, the processor 47 determines one of the plurality ofviewing place candidates as the viewing place based on the taken imagedata. For example, in the plurality of viewing place candidates, thereare included rooms such as a living room, a bedroom, and a washroom. Inthe memory 46, as the reference image data, there is stored in advanceimage data obtained by imaging the inside of the rooms as the viewingplace candidates using the second camera 50.

Specifically, in the step S22, the processor 47 calculates thesimilarity between the taken image represented by the taken image dataand the reference image represented by the reference image data usingthe image processing such as pattern matching. The reference image is animage obtained by imaging the inside of the room as the viewing placecandidate using the second camera 50 as described above. Further, theprocessor 47 determines the viewing place candidate where the takenimage the highest in similarity to the reference image is obtained outof the plurality of viewing place candidates as the viewing place.

As described above, in the step S22, the processor 47 executes obtainingthe second information related to the position of the user 100 based onthe output of the second sensor. In other words, the display methodaccording to the third embodiment includes obtaining the secondinformation related to the position of the user 100 based on the outputof the second sensor. The second information includes the informationrepresenting the viewing place as the place where the user 100 islocated. In the third embodiment, the second camera 50 for taking animage in the 360-degree direction corresponds to the second sensor.

Further, in the display method according to the third embodiment,obtaining the second information includes obtaining a third imageincluding an area included in the 360-degree range centering on thesecond camera 50 based on the output of the second camera 50, anddetermining the viewing place based on the third image. As describedabove, out of the taken image obtained from the second camera 50, thetaken image in which the area included in the 360-degree range centeringon the second camera 50 shows up corresponds to the third image.

As shown in FIG. 16 , the processor 47 executes the step S22 describedabove, and then determines (step S23) the first direction D1 based on acombination of the user ID of the user 100 and the viewing place.Specifically, in the step S23, the processor 47 determines the firstdirection D1 based on the combination of the user ID of the user 100 andthe viewing place, and a direction setting table stored in advance inthe memory 46. FIG. 18 is a diagram showing an example of the directionsetting table. As shown in FIG. 18 , the direction setting table is datarepresenting correspondence relationships between combinations of theuser IDs and the viewing places, and first direction candidates.

For example, in the direction setting table, the combination of the userID corresponding to “user A” and the viewing place corresponding to“living room” is associated with “west” as the first directioncandidate. Further, in the direction setting table, the combination ofthe user ID corresponding to “user B” and the viewing placecorresponding to “bedroom” is associated with “east” as the firstdirection candidate. Further, in the direction setting table, thecombination of the user ID corresponding to “user C” and the viewingplace corresponding to “bedroom” is associated with “ceiling” as thefirst direction candidate.

In the step S23, the processor 47 determines the first directioncandidate corresponding to the combination of the user ID of the user100 and the viewing place out of the first direction candidates includedin the direction setting table as the first direction D1. For example,as shown in FIG. 17 , when “user A” is obtained as the user ID of theuser 100 in the step S21, and “living room” is determined as the viewingplace in the step S22, the processor 47 determines “west” as the firstdirection D1 out of the first direction candidates included in thedirection setting table.

As described above, in the step S23, the processor 47 executesdetermining the first direction D1 based on the information representingthe viewing place as the second information. In other words, the displaymethod according to the third embodiment includes determining the firstdirection D1 based on the information representing the viewing place asthe second information. Determining the first direction D1 includesdetermining the first direction D1 based on the combination of the userID as the first information and the viewing place.

As shown in FIG. 16 , the processor 47 executes the step S23 describedabove, and then controls (step S24) the drive device 30 so that theprojection direction Dp of the projector 10B is turned to the firstdirection D1. More specifically, in the step S24, the processor 47controls the yaw angle θ of the first drive device 31 and the pitchangle α of the second drive device 32 so that the projection directionDp of the projector 10B is turned to the first direction D1.

FIG. 19 is a diagram showing a condition in which the projectiondirection Dp of the projector 10B is turned to the first direction D1.For example, as described with reference to FIG. 17 , when the processor47 determines “west” as the first direction D1 in the state in which theprojection direction Dp of the projector 10B is set in the eastwarddirection, the processor 47 controls the drive device 30 so that theprojection direction Dp of the projector 10B is turned from east towest. As a result, as shown in FIG. 19 , by the projector 10B rotating180 degrees counterclockwise centering on the yaw axis Y, the projectiondirection Dp of the projector 10B is turned to west.

As shown in FIG. 16 , the processor 47 executes the step S24 describedabove, and then determines (step S25) the projection content based onthe combination of the user ID of the user 100 and the viewing place.Specifically, in the step S25, the processor 47 determines theprojection content based on the combination of the user ID of the user100 and the viewing place, and the second content selection table whichis shown in FIG. 13 and is stored in advance in the memory 46.

In the step S25, the processor 47 first selects the video genrecorresponding to the combination of the user ID of the user 100 and theviewing place from the video genres included in the second contentselection table. For example, when “user A” is obtained as the user IDof the user 100 in the step S21, and “living room” is determined as theviewing place in the step S22, the processor 47 selects “movie” from thevideo genres included in the second content selection table. Theprocessor 47 performs the same processing as the processing described inthe first embodiment after selecting the video genre to therebydetermine the projection content.

As described above, in the step S25, the processor 47 executesdetermining the projection content as the type of the image based on thecombination of the user ID as the first information and the informationrepresenting the viewing place as the second information. In otherwords, the display method according to the third embodiment includesdetermining the projection content as the type of the image based on thecombination of the user ID as the first information and the informationrepresenting the viewing place as the second information. Further,determining the projection content as the type of the image includesdetermining the projection content as the type of the image based on thecombination of the user ID as the first information and the viewingplace.

As shown in FIG. 16 , the processor 47 executes the step S25 describedabove, and then controls (step S26) the optical device 41 so that theimage light L representing the image of the projection content isprojected. Since the processing in the step S26 in the third displayprocessing is the same as the processing in the step S6 in the firstdisplay processing, the description related to the step S26 will beomitted.

FIG. 20 is a diagram showing a condition in which the image light L isprojected toward the first direction D1. For example, as shown in FIG.20 , when the processor 47 controls the optical device 41 so that theimage light L representing the projection content is projected in thestate in which the projection direction Dp of the projector 10B isturned to west as an example of the first direction D1, the image lightL is projected westward from the projector 10B. As a result, the videocontent determined as the projection content is displayed on the westside wall surface 240 located at the front direction side of the user100 out of the wall surfaces of the room 200.

As described above, in the steps S23 and S26, the processor 47 controlsthe optical device 41 and the drive device 30 to execute projecting theimage light L representing the image of the projection content as theimage of the determined type toward the first direction D1. In otherwords, the display method according to the third embodiment includesprojecting the image light L representing the image of the projectioncontent as the image of the determined type toward the first directionD1 with the projector 10B.

Advantages of Third Embodiment

As described above, the display method according to the third embodimentincludes obtaining the user ID as the first information for identifyingthe user 100 based on the output of the microphone 48 as the firstsensor, obtaining the information representing the viewing place as thesecond information related to the position of the user 100 based on theoutput of the second camera 50 as the second sensor, determining thefirst direction D1 based on the information representing the viewingplace as the second information, determining the projection content asthe type of the image based on the combination of the first informationand the second information, and projecting the image light Lrepresenting the image of the projection content as the image of thedetermined type toward the first direction D1 with the projector 10B.

Similarly to the first embodiment and the second embodiment, in thedisplay method according to the third embodiment, the projection contentis determined based on the first information of identifying the user 100and the second information related to the position of the user 100, andthe image light L representing the image of the projection content isprojected toward the first direction D1 determined based on the secondinformation.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaymethod in the third embodiment, it is possible to enhance theconvenience of the user 100 when using the projector the projectiondirection Dp of which is variable.

In the display method according to the third embodiment, the secondinformation includes the information representing the viewing place as aplace where the user 100 is located, and determining the first directionD1 includes determining the first direction D1 based on the combinationof the user ID as the first information and the viewing place.

As described above, by determining the first direction D1 based on thecombination of the user ID as the first information and the viewingplace, it is possible to display the image of the projection content onthe projection surface which is easy for the user 100 to visuallyrecognize in accordance with the individual attribute of the user 100and the viewing place, and therefore, the convenience of the user 100 isenhanced.

In the display method according to the third embodiment, determining theprojection content as the type of the image includes determining theprojection content as the type of the image based on the combination ofthe user ID as the first information and the viewing place.

In the first embodiment, the projection content is determined based onthe combination of the user ID as the first information and the soundsource direction Ds. Since the sound source direction Ds is consistentlya direction in which the user 100 is located with respect to the secondsensor, it is difficult to determine the place where the user 100 islocated, namely the room or the like to be the viewing place, from thesound source direction Ds.

Therefore, as described above, by determining the projection contentbased on the combination of the user ID as the first information and theviewing place, it is possible to display the image of the video contentwhich is suitable for the individual attribute of the user 100 and theviewing place on the projection surface, and therefore, the convenienceof the user 100 is further enhanced compared to the first embodiment.

In the display method according to the third embodiment, the secondsensor is the second camera 50 for taking the image in the 360-degreedirection, and obtaining the second information includes obtaining thethird image including the area included in the 360-degree rangecentering on the second camera 50 based on the output of the secondcamera, and determining the viewing place based on the third image.

As described above, by determining the viewing place based on the thirdimage obtained from the second camera 50 for taking the image in the360-degree direction, it is possible to accurately obtain the secondinformation related to the position of the user 100 using the singlecamera.

In the display method according to the third embodiment, the firstsensor has at least one microphone 48, and obtaining the firstinformation includes obtaining the voiceprint data of the user 100 basedon the output of at least one microphone 48, and obtaining the user IDwhich is the identification information representing the user 100 as thefirst information based on the voiceprint data.

As described above, by obtaining the voiceprint data as biological dataunique to the user 100 based on the output of at least one microphone48, it is possible to accurately obtain the user ID of the user 100 asthe first information.

The display system 3 according to the third embodiment is provided withthe microphone 48 as the first sensor, the second camera 50 as thesecond sensor, the optical device 41 for projecting the image light L,the drive device 30 for turning the direction in which the image light Lis projected to the predetermined direction, and the processor 47. Theprocessor 47 executes obtaining the user ID as the first information foridentifying the user 100 based on the output of the first sensor,obtaining the information representing the viewing place as the secondinformation related to the position of the user 100 based on the outputof the second sensor, determining the first direction D1 based on thesecond information, determining the projection content as the type ofthe image based on the combination of the first information and thesecond information, and projecting the image light L representing theimage of the projection content as the image of the determined typetoward the first direction D1 by controlling the optical device 41 andthe drive device 30.

In the display system 3 according to the third embodiment, theprojection content is determined based on the first information ofidentifying the user 100 and the information representing the viewingplace as the second information related to the position of the user 100,and the image light L representing the image of the projection contentis projected toward the first direction D1 determined based on theinformation representing the viewing place as the second information.

Thus, there is increased the possibility that the image of the videocontent suitable for the individual attribute and the position of theuser 100 is displayed on the projection surface which is easy for theuser 100 to visually recognize. Therefore, according to the displaysystem 3 in the third embodiment, it is possible to enhance theconvenience of the user 100 when using the projector 10B the projectiondirection Dp of which is variable.

Although the embodiments of the present disclosure are hereinabovedescribed, the scope of the present disclosure is not limited to theembodiments described above, and a variety of modifications can be madewithin the scope or the spirit of the present disclosure.

For example, in the first embodiment and the second embodiment describedabove, there is illustrated the aspect in which the sound sourcedirection Ds as the second direction in which the user 100 is located,and user direction Du, and the first direction D1 are each representedby four directions of north, south, east, and west. The presentdisclosure is not limited thereto, and each of the directions can berepresented by a coordinate defined by the yaw angle θ and the pitchangle α.

For example, in the first embodiment described above, there isillustrated the aspect in which the projection direction Dp which is thedirection in which the image light L is projected from the projector 10to the first direction D1 by changing the orientation of the projector10 with the drive device 30 externally attached to the projector 10. Thepresent disclosure is not limited thereto, and there can be disposed adrive device for turning the direction in which the image light isprojected from the optical device to a predetermined direction, insidethe chassis of the projector. This drive device can be a device formechanically changing the orientation of the optical device, or can alsobe a device for changing a proceeding direction of the image light withan optical element such as a mirror. As described above, the projectorprovided with the first sensor, the second sensor, the optical device,the drive device, and the processor can be said as the display systemaccording to the present disclosure.

Conclusion of Present Disclosure

Hereinafter, the conclusion of the present disclosure willsupplementarily be noted.

Supplementary Note 1

A display method includes obtaining first information which isconfigured to identify a user, based on output of a first sensor,obtaining second information which is related to a position of the user,based on output of a second sensor, determining a first direction basedon the second information, determining a type of an image based on acombination of the first information and the second information, andprojecting image light representing the image of the type toward thefirst direction with a projector.

The type of the image demanded by the user is different not only by anindividual attribute such as the age, the gender, a job, or a hobby butalso by the position of the user in some cases. In the display methodaccording to Supplementary Note 1, the type of the image is determinedbased on the first information of identifying the user and the secondinformation related to the position of the user, and the image lightrepresenting the image of the determined type is projected toward thefirst direction determined based on the second information.

Thus, there is increased the possibility that the image of the typesuitable for the individual attribute and the position of the user isdisplayed on the projection surface which is easy for the user tovisually recognize. Therefore, according to the display method inSupplementary Note 1, it is possible to enhance the convenience of theuser when using the projector the projection direction of which isvariable.

Supplementary Note 2

The display method according to Supplementary Note 1, wherein the secondinformation includes information representing a second direction inwhich the user is located with respect to the second sensor, and thedetermining the first direction includes determining an oppositedirection to the second direction as the first direction.

As described above, by determining the opposite direction to the seconddirection in which the user is located with respect to the second sensoras the first direction, it is possible to display the image of thedetermined type on the projection surface which is located at the frontdirection side of the user, namely the projection surface which is easyfor the user to visually recognize, and therefore, the convenience ofthe user is enhanced.

Supplementary Note 3

The display method according to Supplementary Note 2, wherein thedetermining the type includes determining the type based on acombination of the first information and the second direction.

As described above, by determining the type of the image based on thecombination of the first information and the second direction, it ispossible to display the image of the type suitable for the individualattribute of the user and the second direction in which the user islocated on the projection surface located at the front direction side ofthe user, and therefore, the convenience of the user is enhanced.

Supplementary Note 4

The display method according to one of Supplementary Note 2 andSupplementary Note 3, wherein the second sensor has a plurality ofmicrophones, and the obtaining the second information includescalculating a time difference generated between times at which a soundwave reaches respective microphones from a sound source based on outputof the plurality of microphones, and determining the second directionbased on the time difference.

As described above, by calculating the time difference between the timesat which the sound wave reaches the respective microphones from thesound source based on the output of the plurality of microphones, it ispossible to accurately obtain a direction in which the sound source islocated with reference to the second sensor as the second direction inwhich the user is located.

Supplementary Note 5

The display method according to Supplementary Note 2, wherein the secondinformation further includes information representing a place where theuser is located, and the determining the type includes determining thetype based on a combination of the first information and the place.

In the display method according to Supplementary Note 3, the type of theimage is determined based on the combination of the first informationand the second direction. Since the second direction is consistently adirection in which the user is located with respect to the secondsensor, it is difficult to determine the place where the user islocated, from the second direction.

Therefore, by determining the type of the image based on the combinationof the first information and the place where the user is located as inthe display method according to Supplementary Note 5, it is possible todisplay the image of the type which is suitable for the individualattribute of the user and the place on the projection surface, andtherefore, the convenience of the user is further enhanced compared tothe display method according to Supplementary Note 3.

Supplementary Note 6

The display method according to Supplementary Note 5, wherein the secondsensor is a first camera configured to take an image in one direction,and the obtaining the second information includes obtaining a firstimage including the user based on output of the first camera,determining the second direction based on the first image, obtaining asecond image including an area located in the first direction based onthe output of the first camera, and determining the place based on thesecond image.

As described above, by determining both of the second direction in whichthe user is located and the place where the user is located based on thefirst image and the second image obtained from the first camera, it ispossible to accurately obtain the second information related to theposition of the user using the single camera.

Supplementary Note 7

The display method according to Supplementary Note 1, wherein the secondinformation includes information representing a place where the user islocated, and the determining the first direction includes determiningthe first direction based on a combination of the first information andthe place.

As described above, by determining the first direction based on thecombination of the first information and the place where the user islocated, it is possible to display the image of the determined type onthe projection surface which is easy for the user to visually recognizein accordance with the individual attribute of the user and the place,the convenience of the user is enhanced.

Supplementary Note 8

The display method according to Supplementary Note 7, wherein thedetermining the type includes determining the type based on acombination of the first information and the place.

In the display method according to Supplementary Note 3, the type of theimage is determined based on the combination of the first informationand the second direction. Since the second direction is consistently adirection in which the user is located with respect to the secondsensor, it is difficult to determine the place where the user islocated, from the second direction.

Therefore, by determining the type of the image based on the combinationof the first information and the place where the user is located as inthe display method according to Supplementary Note 8, it is possible todisplay the image of the type which is suitable for the individualattribute of the user and the place on the projection surface, andtherefore, the convenience of the user is further enhanced compared tothe display method according to Supplementary Note 3.

Supplementary Note 9

The display method according to one of Supplementary Note 7 andSupplementary Note 8, wherein the second sensor is a second cameraconfigured to take an image in a 360-degree direction, and the obtainingthe second information includes obtaining a third image including anarea included in a 360-degree range centering on the second camera basedon the output of the second camera, and determining the place based onthe third image.

As described above, by determining the place where the user is locatedbased on the third image obtained from the second camera configured totake the image in the 360-degree direction, it is possible to accuratelyobtain the second information related to the position of the user usingthe single camera.

Supplementary Note 10

The display method according to any one of Supplementary Note 1 throughSupplementary Note 9, wherein the first sensor has at least onemicrophone, and the obtaining the first information includes obtainingvoiceprint data of the user based on output of the at least onemicrophone, and obtaining identification information representing theuser as the first information based on the voiceprint data.

As described above, by obtaining the voiceprint data as biological dataunique to the user based on the output of at least one microphone, it ispossible to accurately obtain the identification informationrepresenting the user as the first information.

Supplementary Note 11

A display system including a first sensor, a second sensor, an opticaldevice configured to project image light, a drive device configured toturn a direction in which the image light is projected to apredetermined direction, and a processor, wherein the processor isconfigured to execute obtaining first information which is configured toidentify a user, based on output of the first sensor, obtaining secondinformation which is related to a position of the user, based on outputof the second sensor, determining a first direction based on the secondinformation, determining a type of an image based on a combination ofthe first information and the second information, and controlling theoptical device and the drive device to thereby project the image lightrepresenting the image of the type toward the first direction.

In the display system according to Supplementary Note 11, the type ofthe image is determined based on the first information of identifyingthe user and the second information related to the position of the user,and the image light representing the image of the determined type isprojected toward the first direction determined based on the secondinformation.

Thus, there is increased the possibility that the image of the typesuitable for the individual attribute and the position of the user isdisplayed on the projection surface which is easy for the user tovisually recognize. Therefore, according to the display system inSupplementary Note 11, it is possible to enhance the convenience of theuser when using the projector the projection direction of which isvariable.

What is claimed is:
 1. A display method comprising: obtaining firstinformation for identifying a user, based on output of a first sensor;obtaining second information which is related to a position of the user,based on output of a second sensor; determining a first direction basedon the second information; determining a type of an image based on acombination of the first information and the second information; andprojecting image light representing the image of the type toward thefirst direction with a projector.
 2. The display method according toclaim 1, wherein the second information includes informationrepresenting a second direction in which the user is located withrespect to the second sensor, and the determining the first directionincludes determining an opposite direction to the second direction asthe first direction.
 3. The display method according to claim 2, whereinthe determining the type includes determining the type based on acombination of the first information and the second direction.
 4. Thedisplay method according to claim 2, wherein the second sensor has aplurality of microphones, and the obtaining the second informationincludes calculating a time difference between times at which a soundwave reaches respective microphones from a sound source based on outputof the plurality of microphones, and determining the second directionbased on the time difference.
 5. The display method according to claim2, wherein the second information further includes informationrepresenting a place where the user is located, and the determining thetype includes determining the type based on a combination of the firstinformation and the place.
 6. The display method according to claim 5,wherein the second sensor is a first camera configured to take an imagein one direction, and the obtaining the second information includesobtaining a first image including the user based on output of the firstcamera, determining the second direction based on the first image,obtaining a second image including an area located in the firstdirection based on the output of the first camera, and determining theplace based on the second image.
 7. The display method according toclaim 1, wherein the second information includes informationrepresenting a place where the user is located, and the determining thefirst direction includes determining the first direction based on acombination of the first information and the place.
 8. The displaymethod according to claim 7, wherein the determining the type includesdetermining the type based on a combination of the first information andthe place.
 9. The display method according to claim 7, wherein thesecond sensor is a second camera configured to take an image in a360-degree direction, and the obtaining the second information includesobtaining a third image including an area included in a 360-degree rangecentering on the second camera based on the output of the second camera,and determining the place based on the third image.
 10. The displaymethod according to claim 1, wherein the first sensor has at least onemicrophone, and the obtaining the first information includes obtainingvoiceprint data of the user based on output of the at least onemicrophone, and obtaining identification information representing theuser as the first information based on the voiceprint data.
 11. Adisplay system comprising: a first sensor; a second sensor; an opticaldevice which projects image light; a drive device configured to turn adirection in which the image light is projected to a predetermineddirection; and a processor programmed to execute obtaining firstinformation for identifying a user, based on output of the first sensor,obtaining second information which is related to a position of the user,based on output of the second sensor, determining a first directionbased on the second information, determining a type of an image based ona combination of the first information and the second information, andprojecting the image light representing the image of the type toward thefirst direction by controlling the optical device and the drive device.